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DETAILED ACTION 

Drawings 

The drawings are objected to under 37 CFR 1 .83(a). The drawings must 
show every feature of the invention specified in the claims. Therefore, the 
element of "the multispectral band images do not include a panchromatic band 
image" must be shown or the feature(s) canceled from the claim(s). No new 
matter should be entered. 

Specification 

The amendment filed January 25, 2008 is objected to under 35 
U.S.C. 132(a) because it introduces new matter into the disclosure. 35 
U.S.C. 132(a) states that no amendment shall introduce new matter into the 
disclosure of the invention. The added material which is not supported by the 
original disclosure is as follows: "the multispectral band images do not include a 
panchromatic band image." 

Applicant is required to cancel the new matter in the reply to this Office 

Action. 

Claim Rejections - 35 USC §112 

Claims 1-24 and 30-32 are rejected under 35 U.S.C. 112, first paragraph, 
as failing to comply with the written description requirement. The claim(s) 
contains subject matter which was not described in the specification in such a 
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way as to reasonably convey to one skilled in the relevant art that the inventor(s), 
at the time the application was filed, had possession of the claimed invention. 

The element of spatially matching a plurality of multispectral band images 
... wherein "the multispectral band images do not include a panchromatic image" 
is not found in the application as originally filed. 

Pages 3 and 4 of the application as originally filed state that each "image 
produced by a sensor includes multispectral bands. A band of an image is a 
slice of wavelength from the electromagnetic spectrum." For example, a LandSat 
mapper includes eight bands that collect radiation from different parts of the 
electromagnetic spectrum, and of "the eight bands, three bands are visible light, 
one band is panchromatic, three bands are infrared, and one band is thermal 
infrared." 

There is no basis in the application as originally filed for excluding the 
panchromatic image from the plurality of multispectral band images. In fact, the 
application as originally filed lists the panchromatic image as one of the plurality 
of multispectral band images. This interpretation of a plurality of multispectral 
band images as found in the application as originally filed is given in order to 
provide support for spatially matching a plurality of multispectral band images as 
recited in claim 1 as amended. 

Claim 29 is rejected under 35 U.S.C. 112, second paragraph, as being 
indefinite for failing to particularly point out and distinctly claim the subject matter 
which applicant regards as the invention. 
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The phrase "the set resolution level" lacks antecedent basis. 



Claim Rejections - 35 USC § 103 

1 . The following is a quotation of 35 U.S.C. 103(a) which forms the basis for 
all obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or 
described as set forth in section 102 of this title, if the differences between the subject 
matter sought to be patented and the prior art are such that the subject matter as a 
whole would have been obvious at the time the invention was made to a person having 
ordinary skill in the art to which said subject matter pertains. Patentability shall not be 
negatived by the manner in which the invention was made. 

Claims 1-2 are rejected under 35 U.S.C. 103 as being anticipated by U.S. 
Patent No. 6,097,835 issued to Lindgren ("Lindgren") in view of U.S. Patent No. 
7,171,912 issued to Fraisse et al. ("Fraisse"). 

Claim 1 recites "spatially matching a plurality of multispectral band images 

produced by different sensors, the multispectral band images having different 

resolution levels." Support for this claimed element can be found for example in 

figure 3 and pages 3-4 of the disclosure as originally filed, which discloses 

Referring to FIGURE 3, an exemplary process 130 spatially 
matches images produced by a sensor (the block 82 of FIGURE 2). 
Each image produced by a sensor includes multispectral bands. A 
band of an image is a slice of wavelength from the electromagnetic 
spectrum. For example, the LandSat ETM+ (Enhanced Thematic 
Mapper Plus) includes eight bands that collect radiation from 
different parts of the electromagnetic spectrum. Of the eight bands, 
three bands are visible light, one band is panchromatic, three 
bands are infrared, and one band is thermal infrared. At block 140, 
the resolutions of the bands are matched to the most detailed level 
of all the bands of the images received from the sources. For 
example, if the most detailed frame unit of data in one band is 30 
meters (i.e., 30 meter resolution) and 15 meter resolution is 
desired, the data in the 30 meter resolution frame is duplicated to 
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occupy 4 subunits at 15 meter resolution within the original 30 
meter unit. 

Claim 1 also recites "wherein the multispectral band images do not include 
a panchromatic band image." This claimed element lacks support in the 
application as originally filed. In fact, the application as originally filed states that 
the panchromatic image is one of the plurality of multispectral band images as 
discussed on pages 3-4 of the application as originally filed. Thus, the claimed 
"spatially matching a plurality of multispectral band images" is disclosed as 
spatially matching two or more images selected from the visible light bands, the 
panchromatic band, the infrared bands, and the thermal infrared band of each 
multispectral image. The example of matching a band with 30 meter resolution 
to a band with 15 meter resolution presumably means that the 30 meter visible 
light band is spatially matched with the 15 meter panchromatic band. 

Lindgren discloses spatially matching a plurality of multispectral band 
images produced by different sensors, the multispectral band images having 
different resolution levels (see column 6 lines 2-3 describing spatially overlapping 
visible light and panchromatic images) and spectrally correcting one or more of 
the spatially matched images based on one or more of the other images (see 
column 2 lines 25-29). 

Lindgren does not disclose performing at least one of a solar illumination 
correction and an atmospheric correction on the spatially matched images. 
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Fraisse discloses performing at least one of a solar illumination correction 
and an atmospheric correction on the spatially matched images (see column 2 
line 47- column 7 line 21). 

It would have been obvious to one of ordinary skill in the art at the time of 
the invention to perform the atmospheric correction of Fraisse with the pan 
sharpening method of Lindgren to increase the image resolution as taught by 
Fraisse at column 7 lines 19-22. 

Although the claim element of "wherein the multispectral band images do 
not include a panchromatic image" is unsupported by the disclosure as originally 
filed, this element will be addressed in light of the prior art in order to advance 
prosecution. 

Performing the step of spatially matching using images that do not include 
panchromatic images is within the abilities of a skilled artisan at the time of the 
invention using the method of Lindgren. If the method of Lindgren is modified to 
replace the known panchromatic image with a second visible light image having 
a spatial resolution different than the resolution of the first visible light image 
discussed in Lindgren, and a skilled artisan applies the known spatially matching 
method of Lindgren to the two visible light images of different resolutions 
according to its established function, the result would be the predictable output of 
two spatially matched images. Such a solution is obvious to try, because a 
skilled artisan would have satellite images from a finite number of bands, and 
would reasonably expect a method that works with two of the bands to work with 
any of the bands. 
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For claim 2, Lindgren discloses equalizing the resolution levels in the 
images and the means for equalizing the resolution levels (see column 2 lines 
29-31). 

2. Claim 3 is rejected under 35 U.S.C. 103 as being anticipated by Lindgren 
in view of Fraisse and U.S. Patent No. 5,995,681 issued to Lee et al. ("Lee"). 

For claim 3, Lindgren and Fraisse disclose the elements of base claims 1 

and 2. 

Lindgren and Fraisse do not explicitly disclose setting a plurality of control 
points in the images based on landmark information and aligning the images 
based on the set control points. 

Lee discloses setting a plurality of control points in the images based on 
landmark information and aligning the images based on the set control points as 
shown in Figure 1 . 

It would have been obvious to one of ordinary skill in this art at the time of 
this invention to align the panchromatic and multispectral images of Lindgren 
using the control points obtained from a survey or reference image of the 
geographical area of interest in order to co-register the images as taught by Lee 
in columns 1 -2 and figure 1 . 

3. Claims 4-8 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Lindgren in view of Fraisse and Lee as applied to claim 3 above, and further 
in view of U.S. Patent No. 5,864,632 issued to Ogawa et al. ("Ogawa"). 
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For claim 4, Lindgren, Fraisse and Lee disclose the elements of base 
claim 3. 

Lindgren, Fraisse and Lee do not explicitly disclose determining locations 
of a plurality of landmarks, presenting a selected landmark, setting a control point 
approximately adjacent to the selected landmark, and repeating until a threshold 
number of control points are set. 

Ogawa in step 202 of figure 2, figure 7 and column 6 lines 32-38 shows 
determining locations of a plurality of landmarks, presenting a selected landmark, 
setting a control point approximately adjacent to the selected landmark, and 
repeating until a threshold number of control points are set. 

It would have been obvious to one of ordinary skill in this art at the time of 
invention to set control points in the images of Lindgren, Fraisse and Lee 
adjacent to selected landmarks as shown by Ogawa for the purpose of aligning 
multiple images of the same geographic location as taught by Ogawa at column 
5 lines 33-36. 

For claims 5-6, Ogawa in figure 7 shows the landmarks include a building 
and a field. Given the fact that the neither the claims nor the specification 
establishes a critical distinction between a building and a school building, or a 
field and a football field, one of ordinary skill in the art would obviously recognize 
that the building of Ogawa can be a school building and the field can be a football 
field. 

For claims 7-8, Lindgren discloses setting the multispectral resolutions to 
an equalized resolution in the abstract and figure 4. 
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4. Claims 9-1 0 are rejected under 35 U.S.C. 1 03(a) as being unpatentable 
over Lindgren in view of Landsat-7 Science Data User's Handbook solar 
illumination algorithm ("Landsat-7") cited by applicant on pages 5-7 of the 
originally filed disclosure. Although the Landsat-7 algorithm does not list a 
publication date, presumably this is admitted prior art and not an invention by 
applicants. 

For claim 9, the means for spatially matching and means for spectrally 
correcting are defined by the specification as computer software that is executed 
by a processing system, which is disclosed by Lindgren as discussed at length in 
the response to arguments and again in the rejection of claim 1 above, and the 
means for performing atmospheric correction is disclosed by Landsat-7. It would 
have been obvious to one of ordinary skill in the art at the time of invention to 
perform solar illumination correction on the satellite images of Lindgren for the 
benefit of reducing between-scene variability. 

Performing the step of spatially matching using images that do not include 
panchromatic images is within the abilities of a skilled artisan at the time of the 
invention using the method of Lindgren. If the method of Lindgren is modified to 
replace the known panchromatic image with a second visible light image having 
a spatial resolution different than the resolution of the first visible light image 
discussed in Lindgren, and a skilled artisan applies the known spatially matching 
method of Lindgren to the two visible light images of different resolutions 
according to its established function, the result would be the predictable output of 
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two spatially matched images. Such a solution is obvious to try, because a 
skilled artisan would have satellite images from a finite number of bands, and 
would reasonably expect a method that works with two of the bands to work with 
any of the bands. 

For claim 10, Lindgren discloses equalizing the resolution levels in the 
images and the means for equalizing the resolution levels (see column 2 lines 
29-31). 

5. Claim 11 is rejected under 35 U.S.C. 103 as being anticipated by Lindgren 
in view of Landsat-7 as applied to claims 9-10 above and further in view of U.S. 
Patent No. 5,995,681 issued to Lee et al. ("Lee"). 

For claim 1 1 , Lindgren and Landsat-7 disclose the elements of base 
claims 9-10. 

Lindgren and Landsat-7 do not explicitly disclose setting a plurality of 
control points in the images based on landmark information and aligning the 
images based on the set control points. 

Lee discloses setting a plurality of control points in the images based on 
landmark information, aligning the images based on the set control points, and 
aligning images based on latitude and longitude as discussed in column 1 lines 
48-50 and shown in Figure 1 . It would have been obvious to one of ordinary skill 
in this art at the time of this invention to align the panchromatic and multispectral 
images of Lindgren using the latitude, longitude, or control points obtained from a 
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survey or reference image of the geographical area of interest in order to co- 
register the images as taught by Lee in columns 1-2 and figure 1 . 

6. Claims 12-16 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Lindgren in view of Landsat-7 and Lee as applied to claim 1 1 above, and 
further in view of U.S. Patent No. 5,864,632 issued to Ogawa et al. ("Ogawa"). 

For claim 12, Lindgren, Landsat-7 and Lee disclose the elements of base 
claim 1 1 . Ogawa in step 202 of figure 2, figure 7 and column 6 lines 32-38 
shows determining locations of a plurality of landmarks, presenting a selected 
landmark, means for setting a control point approximately adjacent to the 
selected landmark, and repeating until a threshold number of control points are 
set. It would have been obvious to one of ordinary skill in this art at the time of 
invention to set control points in the images of Lindgren, Landsat-7 and Lee 
adjacent to selected landmarks as shown by Ogawa for the purpose of aligning 
multiple images of the same geographic location as taught by Ogawa at column 
5 lines 33-36. 

For claims 13-14, Ogawa in figure 7 shows the landmarks include a 
building and a field. 

For claims 15-16, Lindgren discloses setting the multispectral resolutions 
to an equalized resolution in the abstract and figure 4. 
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7. Claims 17, 20-21 and 23-24 are rejected under 35 U.S.C. 103 as being 
unpatentable over Lindgren in view of Landsat-7 and further in view of U.S. 
Patent No. 5,995,681 issued to Lee et al. ("Lee"). 

For claim 17, Lindgren discloses spectrally correcting one or more of the 
spatially matched images based on one or more of the other images (see column 
2 lines 25-29). Landsat-7 performing a solar illumination correction. It would 
have been obvious to one of ordinary skill in the art at the time of invention to 
perform solar illumination correction on the satellite images of Lindgren for the 
benefit of reducing between-scene variability. 

Lee discloses a system for aligning a plurality of satellite images 12 from 
different sources (such as airborne or spaceborne camera or radar systems, 
diagrammatically illustrated at 10 and 11, respectively in Figure 1), user interface 
device 24, a display device 25, a database for storing landmark information (the 
workstation 24 stores reference images 29 in its memory), a processor coupled 
to the user interface device, the display device, and the database, the processor 
including a first component for instructing the display device to present one of the 
satellite images based on the stored landmark information, a second component 
for setting control points in the satellite images based on a signal generated by 
the user interface, and a third component for aligning the images based on the 
set control points (see column 1 line 52-column 2 line 10 which discusses a 
skilled operator at an image processing workstation 24 examine the display 25 of 
the working digital image 16 to locate ground control points 27. The ground 
control points are obtained from stored landmark information such as a survey of 
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the area of interest. By clicking on a cursor 31 that has been manually 
positioned over a control point in the working image, the operator supplies an 
offset which is compared with the actual coordinates of the ground control point 
in the reference image 29). It would have been obvious to one of ordinary skill in 
this art at the time of this invention to align the panchromatic and multispectral 
images of Lindgren using the control points obtained from a survey or reference 
image of the geographical area of interest in order to co-register the images as 
taught by Lee in columns 1-2 and figure 1. 

Performing the step of spatially matching using images that do not include 
panchromatic images is within the abilities of a skilled artisan at the time of the 
invention using the method of Lindgren. If the method of Lindgren is modified to 
replace the known panchromatic image with a second visible light image having 
a spatial resolution different than the resolution of the first visible light image 
discussed in Lindgren, and a skilled artisan applies the known spatially matching 
method of Lindgren to the two visible light images of different resolutions 
according to its established function, the result would be the predictable output of 
two spatially matched images. Such a solution is obvious to try, because a 
skilled artisan would have satellite images from a finite number of bands, and 
would reasonably expect a method that works with two of the bands to work with 
any of the bands. 

For claim 23, Lindgren discloses setting multispectral bands to equalized 
resolution levels as shown in Figure 4. 
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For claim 24, setting the resolution level to a highest level is shown by 
Lindgren in Figure 4. 

8. Claims 18-19 and 22 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Lindgren in view of Landsat-7 and Lee as applied to claim 17 
above, and further in view of U.S. Patent No. 5,864,632 issued to Ogawa et al. 
("Ogawa"). 

For claim 18, Lindgren, Landsat-7 and Lee disclose the elements of base 
claim 17. Ogawa in figure 7 discloses the landmark includes a building, which 
can be a school. It would have been obvious to one of ordinary skill in this art at 
the time of invention to set the control points of Lee using school building 
information for the purpose of aligning the multiple images of the same 
geographic location as taught by Ogawa at column 5 lines 33-36. It would have 
been obvious to one of ordinary skill in this art at the time of invention to set 
control points in the images of Lindgren, Landsat-7 and Lee adjacent to selected 
landmarks as shown by Ogawa for the purpose of aligning multiple images of the 
same geographic location as taught by Ogawa at column 5 lines 33-36. 

For claim 19 Ogawa discloses that the building information includes 
location information. 

For claim 22 Ogawa discloses that the visual feature includes a field, 
which obviously can be a football field. 
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9. Claims 25 and 29 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Lee in view of Lindgren. 

For claim 25, Lee discloses a user interface comprising a first component 
for displaying one of the satellite images (display device 25), a second 
component for selecting a landmark from a database of landmarks located within 
a geographic area common to the plurality of satellite images (see ground control 
points 27 discussed at column 1 lines 52-61 which together are "a database of 
landmarks" and library of images 130 discussed at col. 4 lines 58-60 which is a 
database of images having landmarks); a third component for adjusting the 
displayed satellite image to present the selected landmark (see column 1 lines 
52-61 ); and a fourth component for selecting a control point associated with a 
visual feature that is approximately adjacent to the selected landmark (see 
column 1 lines 52-61 and col. 5 lines 16-34). 

Lindgren discloses multispectral band satellite images that include images 
from a group consisting of at least one of one or more visible light images, one or 
more infrared images, and one or more infrared images (see figures 1 and 3). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to modify the display of Lee to use satellite images that include images 
from a group consisting of at least one of one or more visible light images, one or 
more infrared images, and one or more infrared images as disclosed by Lindgren 
because the combination is the predictable use of two display methods, one by 
the other, according to their established functions to achieve the predictable 
result of displaying a visible light image of Lindgren on the display system of Lee. 
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Performing the step of spatially matching using images that are selected 
from the group consisting of visible light images, infrared images, and thermal 
images, where the images have different resolutions, is within the abilities of a 
skilled artisan at the time of the invention using the method of Lindgren. If the 
method of Lindgren is modified to replace the known panchromatic image with a 
second visible light image having a spatial resolution different than the resolution 
of the first visible light image discussed in Lindgren, and a skilled artisan applies 
the known spatially matching method of Lindgren to the two visible light images 
of different resolutions according to its established function, the result would be 
the predictable output of two spatially matched images. Such a solution is 
obvious to try, because a skilled artisan would have satellite images from a finite 
number of bands, and would reasonably expect a method that works with two of 
the bands to work with any of the bands. 

For claim 29, setting the resolution level to a highest level is shown by 
Lindgren in Figure 4. 

1 0. Claims 26-27 are rejected under 35 U.S.C. 1 03(a) as being unpatentable 
over Lee in view of Lindgren and further in view of Ogawa. 

Lee and Lindgren disclose the elements of base claim 25. 

For claim 26, Ogawa discloses that the building information includes 
location information. 

For claim 27 Ogawa discloses that the visual feature includes a field, 
which obviously can be a football field. 
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It would have been obvious to one of ordinary skill in this art at the time of 
invention to set the control points of Lee using school building information for the 
purpose of aligning the multiple images of the same geographic location as 
taught by Ogawa at column 5 lines 33-36. 

1 1 . Claims 30-32 are rejected under 35 U.S.C. 103 as being anticipated by 
Lindgren in view of U.S. Patent No. 5,995,681 issued to Lee et al. ("Lee"). 

For claim 30, Lindgren discloses spatially matching images produced by 
different sensors (see Lindgren column 6 lines 2-3 describing spatially 
overlapping multispectral and panchromatic images) spectrally correcting one or 
more of the spatially matched images based on one or more of the other images 
(see Lindgren column 2 lines 25-29). Lee discloses setting a plurality of control 
points in the images based on landmark information and aligning the images 
based on the set control points as discussed in columns 1 and 2 and shown in 
Figure 1. 

It would have been obvious to one of ordinary skill in this art at the time of 
this invention to align the multispectral images of Lindgren using the control 
points obtained from a survey or reference image of the geographical area of 
interest in order to co-register the images as taught by Lee in columns 1-2 and 
figure 1 . 

Performing the step of spatially matching using images that are selected 
from the group consisting of visible light images, infrared images, and thermal 
images, where the images have different resolutions, is within the abilities of a 
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skilled artisan at the time of the invention using the method of Lindgren. If the 
method of Lindgren is modified to replace the known panchromatic image with a 
second visible light image having a spatial resolution different than the resolution 
of the first visible light image discussed in Lindgren, and a skilled artisan applies 
the known spatially matching method of Lindgren to the two visible light images 
of different resolutions according to its established function, the result would be 
the predictable output of two spatially matched images. Such a solution is 
obvious to try, because a skilled artisan would have satellite images from a finite 
number of bands, and would reasonably expect a method that works with two of 
the bands to work with any of the bands. 

For claim 31 , Lindgren extracts radiometrically stable data, aggregates the 
data from a first image, compares the aggregated data to radiometric data from a 
second image, generates a correction factor, and applies the correction factor to 
the radiometric data of the second image as shown in figures 1 and 2. 

For claim 32, Lindgren discloses spatially matching multispectral band 
images of different resolution levels as shown for example in figures 1 and 4. 



Response to Arguments 

Applicant's arguments filed January 25, 2008 have been fully considered 
but they are not persuasive. 

Applicant argues that the prior art does not disclose spatially matching a 
plurality of multispectral band images produced by different sensors, the 
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multispectral band images having different resolution levels, wherein the 
multispectral band images do not include a panchromatic image. 

Applicant has not shown support in the application as originally filed for 
this amendment. 

Applicant has also not shown any unpredictable results that are achieved 
by replacing a panchromatic image with a non-panchromatic and applying the 
spatially matching method known in the prior art. What is the significance of 
using non-panchromatic images? What results are achieved by the use of non- 
panchromatic images that are not predictable from the method that uses 
panchromatic images? 

Applicant's amendment necessitated the new ground(s) of rejection 
presented in this Office action. Accordingly, THIS ACTION IS MADE FINAL. 
See MPEP § 706.07(a). Applicant is reminded of the extension of time policy as 
set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire 
THREE MONTHS from the mailing date of this action. In the event a first reply is 
filed within TWO MONTHS of the mailing date of this final action and the advisory 
action is not mailed until after the end of the THREE-MONTH shortened statutory 
period, then the shortened statutory period will expire on the date the advisory 
action is mailed, and any extension fee pursuant to 37 CFR 1.136(a) will be 
calculated from the mailing date of the advisory action. In no event, however, will 
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the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

Any inquiry concerning this communication or earlier communications from 
the examiner should be directed to JEFFREY S. SMITH whose telephone 
number is (571)270-1235. The examiner can normally be reached on M-F. 

If attempts to reach the examiner by telephone are unsuccessful, the 
examiner's supervisor, Jingge Wu can be reached on 571 272-7429. The fax 
phone number for the organization where this application or proceeding is 
assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from 
the Patent Application Information Retrieval (PAIR) system. Status information 
for published applications may be obtained from either Private PAIR or Public 
PAIR. Status information for unpublished applications is available through 
Private PAIR only. For more information about the PAIR system, see http://pair- 
direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll- 
free). If you would like assistance from a USPTO Customer Service 
Representative or access to the automated information system, call 800-786- 
9199 (IN USA OR CANADA) or 571-272-1000. 

/Andrew W. Johns/ 

Primary Examiner, Art Unit 2624 

JSS 

April 4, 2008 
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